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; ^ v t ; '^ — - -: 

A computerized ' interactor 
system ; uses physical, thriee- 
dimensipnal objects ^ as^ metaphors 
for input of userv intent ■,[' to a 1 
computer system.--"- When one or ~ - 
more interactorsyare engaged with 
a detection field, ;; ;the^ detection 
field reads an identifier associated * 
with the object* and . communicates 
the identifier, to- a .computer \ _~. 
system. " The computer system "\ 
determines^ the * meaning of* the • • 
interactor based upon its , identifier , . 
and upon a semantic context in 
which the u computer ^system is 
operating: \ , The * interactprs xari r : 
be used to, control other systems, 
such as audio systems? "or it/ 1 * "■" 
can be used as. intuitive inputs 
into a computer system for such 
purposes as ' marking' events in* a" 
temporal flow. . : ;The- interactprs, : 
as- a ..minimum, communicate 
their identity* hut; may /also be. 
more sophisticated in that -they 
can ^ communicate additional 
processed or unprocessed data, 
i.e. they can include their own 
data processors. The detection 
field can be one-dimensional or 
multi -dimensional, and typically has different semantic meanings associated with different 7 parts of the detection field. 
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Computerized Intera ctor Systems And Methods For Providing Same 

Description 

Technical Field 

5 This invention relates generally to human/computer interfaces and more 

particularly to mechanical input devices for computerized systems. 

Background Art 

It has become increasingly common to computerize systems, from the trivial 
10 (e.g., the computerized toaster or coffee pot) to the exceedingly complex (e.g., 
complicated telecommunications and digital network systems). The advantage of 
computerization is that such systems become more flexible and powerful. However, 
the price that must be paid for this power and flexibility is, typically, an increase in the 
difficulty of the human/machine interface. 

1 5 The fundamental reason for this problem is that computers operate on principles 

based on the abstract concepts of mathematics and logic, while humans tend to think in 
a more spatial manner. People inhabit the real world, and therefore are more 
_conrfortable with physical, three-dimensional objects than they are with the- abstractions 
of the computer world. Since people A do, not - think like computers, metaphors are 

20 adopted to permit people to effectively communicate with computers. In general, better 
metaphors permit more efficient and medium independent coirimunicatioris between 
ppople and computers. . . , 

iy.u j ■ : There are, of course, a number of human/computer interfaces which allow 
users, with varying degrees of comfort and ease, to interact with .computers. ,For 
25 example, keyboards, computer mice, joysticks, etc. allow users to physically 

J manipulate a three-dimensional object to create an input into a computer system. 
However, these human/computer interfaces are quite artificial in nature, and tend to 
require a substantial investment in training to be used efficiently. „ ( * t 

< Progress has been made in improving the human/computer interface with the 
30 graphical user interface (GUI). With a GUI interface, icons are : presented on a 
computer screen which represent physical objects. For example, a document file may 
: )r - look like a page of a document, a directory file might look like a file folder, and an icon 
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of a trash can be used for disposing of documents arid files. In other words, GUI 
interfaces use "metaphors" where a graphical icon represents a physical object familiar 
to users. This makes GUI interfaces easier to use for most users. GUI interfaces were 
pioneered at such places as Xerox PARC of Palo Alto. California and Apple Computer, 

5 Inc. of Cupertino, California. The GUI is also often commonly used with UNIX™ 
based systems, and is rapidly becoming a standard in the PC-DOS world with the 
Windows™ operating system provided by Microsoft Corporation of Redmond, 

* 'i - Washington. 

While GUIs are a major advance in human/computer interfaces, they 

10 nonetheless present a uW with a learning curve due to their still limited metaphor. In 
other words, ah icon can only represent' a physical object: it is not itself a physical 
object. ; Recognizing this problem, a number of researchers and companies have come 
- up with alternative humanteomputer interfaces which operate on real-world metaphors. 
Some 6f these concepts' are' described in the July, ' 1993 special issue of 

15 Communications of the ACM, in an article entitled "Computer Augmented 
Environments, Back WthTReaTWoriil" Such computer; augmented environments 
include immersive environments, where rooms are filled with sensors to control the 
settings of the room, ; as researched at New York University (NYU) in New York, New 
York. Another example is the electronic white boards of Wacom and others where 

20 ordinary-looking erasers and markers are used to create an electronic "ink." Wellner 
■> ■ ■ describes a "DigitalDesk" that uses video cameras, paper, and a work station to move 
between the paper and the electronic worlds. Fitzmafice has a "Chameleon" unit which 
allows a user to walk up to a bookshelf and press a touch-sensitive LCD strip to hear 
more about a selected book: Finally, MIT Media Lab has a product known as 

25 Leggo/Lbgb wWch lets chUdreii program by snapping plastic building blocks together, 
where each of the building blocks includes an embedded microprocessor. 

- Bishop, who is a co-inventor of the invention described and claimed herein, has 
developed a "marble answering machine" which appears to store a voice mail message 
in a marble that drops into a cup. the marble, in fact, triggers a pointer on a small 
30 computer which stores the message. To play back the message; the marble is dropped 
<••■'■ into the machine again. This marble answering machine has been publicly known at 
least as of June; 1993. 

While strides have been made in attempting to improve human/computer 
interfaces, there is still progress to be made in this field. Ultimately, the interface itself 
3 5 should disappear from the conscious thought of users so that they can intuitively 
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accomplish their goals t without concern to the mechanics of the interface or the 
underlying operation of the computerized system. 

Disclosure of the Invention ? ~ 

5 The present invention iniproves the human-computer interface by using 

"interactors." An interface couples a detection field to a controller computer system 
which, in turn, may be coupled to other systems. When an interactor is entered into the 
detection field, moved about within the detection field, or removed from the detection 
field/ an event is detected which, when communicated, to the, computer system, can be 
* 9 u ^ to c r re ? t ?: a . con , tI ?! F signal for either the controller computer system or to a system 
, connected to the controller^ system... jpreferaW^ field is suitably 

sized and configured.so that multiple users r can simqlt^equsly^access^e field and such 
that multiple mterac 

By "interactor" it is meant, Jto^.a : p^^ used that can 

1 5 con y e y information both to the controller cornputier system and to users. An interactor 
can prpyijde identity computer 
chip, a bar code, etc. An object can also^be , made,.into an interactor by embedding 
higher-level logic, such as a program logic array, microprocessor, or even a full-blown 
microcomputer. An interactor forms part of a system wherein information is assigned 
20 by users to at least one object. . , t . fi . . ■ 

An interactor system in. accordance with . the ^present invention includes a 
.detection space and a number of interactors ^which : ,cQn: be. xnwu^ly^fnanipulated within 
the detection space. ^ The interactors, ^ preferably v^ye \a- ^nigiie^ED. An interface 
responsive to the interactors in the detection space provides signals to communicate 

25 infonnation, concerning the interactors (e.g. ID, . position, EXIT/ENTER, and 
"temporal" information) to the computer, system. The. EXIT/ENTER will often be 
referred to as UP/DOWN when referring to a two dimensional detection field, since an 
interactor is entered by putting it down on the field„and is exited by, picking it up from 
the field. Importantly, the computer system /processes the , information within a 

3 0 semantic context to accomplish a user-desired task.i By . "semantic", it/is meant that the 
meaning of an interactor is dependent upon the context in which it is being used, both 
.in terms of explicit and implicit assignments of function and -content. 

] As will be appreciated from the above discussion, a method for controlling a 
bomputerized system includes the steps of: a) providing a detection space; b) placing a 
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physical, identifiable interactor having a semantic meaning within the detection space; c) 
determining the meaning of the interactor within the semantic context; and d) controlling 
a computerized system in response to the semantic meaning of the interactor. 

There are a number of specific applications for the interactor technology of the 
5 present invention. Two examples are given, one which allows for the control of an 
audio system to create a "virtual room", and the other which provides an event marking 
system for recorded media or other time based activities. , 

In the first example, an audio system is provided which can bring a number of 
widely dispersed individuals together into a common auditory space. For example, the 

1 0 audio system can provide a "virtual room^iri which individuals are brought together in 
the auditory sense from various locations. For example, individuals A, B, and C can 
be in. separate physical offices, yet^ individual A- triight wish to casually chat with 
individuals B and C as if they were in the same office space. -Individual A then uses 
interactors representing B and C (perhaps with their pictures on them) in a detection 

1 5 k field to , indicate that he wishes to converse with individuals B and C. The interactors 
detected by the detection field generate control signals within a dbntrolling computer to 
control microphones, speakers, and amplifiers to make this happen. In this fashion, 
and by a very simple metaphor, A, B, arid C can be made td inhabit the same "virtual 
room" for conversation and other auditory communication. 1 : 



20 In *e second example,*- videotape "marking" system is described. A videotape 

player is coupled to a controlling computer, and a videotape is played and observed by 
one or more users on. a: monitor. When ah event occurring on the videotape is to be 
logged or marked, an interactor is engaged with the detection field? -'The controlling 
computer then retrieves timing information from the videotape player and combines this 

2 5 ^ , ,with the marking .event. Removal of the interactor from the detection field can signify 

the end of the event, or can signify nothing, depending upon the context and the desires 
of the users. The detection field is preferably sized and configured so that multiple 
viewers of the video playback can simultaneously access the detection field. By taking 
a group approach, each individual can be watching for and marking a specific event or a 

3 0 small group of events. This approach can reduce the fatigue and tedium with logging 

videotape. . < ■ ■ \ 

By using interactors, the human/computer interface is greatly enhanced. In the 
example of the audio control system, it takes little or no training to use the system since 
the interactors and their spatial relationships are intuitive to the user. Likewise, it is a 
35 very physically intuitive gesture for a user to place a labeled or otherwise evocative 
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interactor on a detection field in response to a certain event detected in a video playback. 
The present invention therefore provides a more intuitive and richer metaphor for the 
interaction between * humans and' computerized systems. Furthermore, the present 
invention provides a system whereby multiple users simultaneously communicate with 
5 a. computerized system using the metaphor v 1 

These and other advantages of the present invention Will become apparent upon 
reading the following detailed descriptions and studying the various figures of the 
drawings. 




1 0 . Brief Description of the Drawings . ^ s - :i . ? ' o j ^ 

t v . j , , Fig :V l is a pictorial, representation of &h interactdr system in accordance with the 

: ^ , f present : inyention; : , - ^ :i£l)i: y Vl. v-; vrd* Zl sr. -J j-t ; ^ ^c:-/.:^^^ 

.^Fig. 2 isapictori^^ of the present 

invention;; ^ ; r , rK y> .:.M--;.v/f:V- L£:*V noil-re&b on; y.< ■-,!> 

1,5 . ; r , u JFig. I Jis, a, side eleyational. view^^pfi^a^ twp-dimensional r detection field in 
accordance of the present invention;,:. >r; i V ^ :• - 

f : :7 Fig r 44s a top plan yiew^t^ :> 

-v^I/ : ^;^jg-- 5 is a perspective , view ofr an unteraetor in : accordance ^with the present 
, invention;, ; v + ^ ••• ■; -w-"-. ■.■ ,fc;::'i ,j v^ b^-.;' 

20 ,: fi ^ , Fig. 5a is : a schema ihteractor of 

,_. ;o ,Fig^5; ^ i/:r , , - ^ w \ > \. V, > .-i.; ■ f t J 

;> j^ig- 6 is a schematic diagram of the circuitry of the detection 1 field illustrated in 
. v . Figs. 3 and 4; ^ ...... = ■ . —v-. / r.::»> • >>'..,■,,.:<:. 

■ r v •-. . ■■ j " ... - - : - c v 1 j :; i-; - 

Fig. 7 is a flow diagram of a computer implemented process running on the 

2 5 microprocessor of Fig. 6; 

v Fig. 8a is a data word produced by the process of Fig. 7; 
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Fig. 8b is a table illustrating the meanings associated with the state bit of the 
data word of Fig. 8a; 

Fig. 9a illustrates a one-dimensional detection field; 

Fig. 9b illustrates both a three-dimensional and a four-dimensional detection 
5 field; ...... • , v 

Fig. 9c illustrates*an alternative three-dimensional detection field; 

Fig. 10 illustrates an interactor used to control an audio system; 

Fig. 1 la illustrates a first embodiment of the audio control system wherein the 
user is; embodied into the system; 

1 0 3 Fig. Tib illustrates a second embodiment of the audio control system wherein 

the*usdr ^ i.e/is omniscient to the system; 

•Fig: 1 1 lb -illustrates a layout of a two-dimensional detection field used for the 
audio control device; 

Fig. 12 is a block diagram for an audio control system of the present invention. 

15 Fig. 1 3 is a block diagram representing the computer implemented processes 

running on the computers and server of Fig. 12; 

Fig. 14 is a flow diagram illustrating the operation of thib application program of 
Fig. 13; 

Fig. 15 is a flow diagram illustrating the operation of the network library of 
20 Fig. 13; 

" Fig- 1 6 is a flow diagram illustrating the server software operation of Fig. 13; 

J Fig 17 is an illustration of interactors on a detection field for marking events in 
temporal flows; 

: Fig. 18 is a flow diagram of an event marker system in accordance with the 
25 present invention; v ...... 
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Fig. 19 is>a flow diagram illustrating the "Control Media Based On Event" step 
of Fig. 18; i - 

Fig. 20'is a flow diagram illustrating the "Process Binding Event" step of Fig. 

18; 

5 Fig. 21 is a flow diagram of the "Mark Temporal Flow" step of Fig. 18; and 

>Fig. 22; is : a flow, diagram illustrating the 'Tfocess Other Event" step of Fig. 18. 

Best Modes for Carrying out the Invention 

In Fig. 1, an interactor system 10. includes a detection, space f 12, a controller 
10 computer 14, and an optional system 16. A number of interactors 18 (which will be 
discussed more fully hereafter) may £^ in, and removed 

from the.jdetQction^ space. 1 2. These i^ter^ctor§ - 181 : in : conjunction, with the detection 
space 12 help define a human/computer interface that is intuitive, flexible,, rich in 
meaning,, and is well adapted for use T by multiple s 

15 As used herein, the term "detection space" or the like will refer to any n- 

dimpnsional . space in the physical world. The detection space will be alternatively 
referred to as a "detection field" an "event field," and the like. Therefore, such terms 
^^^as/^spacft," "field " "domain /'/.Volume," should be. c synonymous as used 

herein. However, "field". wiM .be ^ to a two 

2 0 dimensional detection space, while "space" will be used more frequently with respect to 
a three dimensional detection space. f . , 

j ^ ....... ^ ... - ...... 

Since we live in a three-dimensional world, any real-world detection space will 
have a three-dimensional aspect. However,, if. only two of those dimensions are used 
as input to the computer 14, we will refer to the detection field as a £ "two dimensional." 
25 Likewise, if only one-dimension is used as an input to computer 14, we will refer 
^ herein to such a field as "one dimensional.". Furthermore, an; certain embodiments of 
the present invention, the detection space may be time-variant, allowing the inclusion of 
four dimensional detection spaces. Various , examples of detection spaces and fields 
will be discussed in greater detail subsequently. 

30 .Computer 14 is preferably a general, puippse, microcomputer made by any one 

of a variety of commercial vendors. For example, computer H : can be a Macintosh 
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computer system made by Apple Computer, Inc. or a,P<G/AT„compatible DOS computer 
system made by Compaq, IBM, Packard-Bell, or others. Computer 14 is coupled to 
the detection space 12 as indicated, at 20 such that it may receive information concerning 
an interactor 18 placed within the detection space 12. An interface is provided between 
5 the detection space 12 and the computer 14 which may. b& either internal to or external 
of the computer system 14. The design and implementation of interfaces is well known 
to those skilled in the art, although a preferred -implementation of an interface of the 
present invention will be. discussed in greater detail subsequently. ,. 

, By coupling the optional system 1 6 to computer 14; interactors and the optional 
*P ..Syste^ l^^int^ computer, 14.- The-system 16 may serve as an 

( ,. input to computer ^van-output fro^ as m mput to 

. computer 14 ; , the system .1,6 can provide data on a line -22. which is used in conjunction 
^wi^h4ajJM?n line 20 derived irom the interaction of an interactor. 18 with the detection 
space 12 t . When used as.an output from the computer system 14, the system 16 can be 
15 controlled by the interaction of the interactor 18 with the detection space 12. The 
system l ^,c^n be of a standard commercial design (e.g. a videotape player), or can be a 
custom system designed for a particular .use. - > 

_ y . An interactor system 24 used to "mark events in a temporal flow is illustrated 
somewhat schematically, in Eig; 2. The interactor, system 24 includes a detection field 
20 26, a computer 28, and a video system 30. With the interactor system 24, a videotape 
or other video source can be displayed on a screen 32 of the video system 30 and 
events can.be "marked^ .by engaging interactors 34 with the , detection field 26. The 
images on video, screen, 3 2 may be Recorded such as within a recording/playback unit 35 
°f Y 1 ??? *y^ m 30 ?^ r = m ^y ^ purely transitory images, such.as those produced by 
a .>'f deo camera 3$ '..of the Video system .30. If recorded, the images: can be "marked" 
cpntemporaneously with recording of the image, or after the fact. In the latter instance, 
the unit 35 would simply be used in its playback mode to playback an earlier recorded 
video tape for event, marking. . 

. . The detection, field 26 is, in this embodiment, a two-dimensional detection field 
3 ; 0 in that it can detect positions of interactors 34 in both an "x" and a "y" direction. 
However,, the detection field 26 of Fig, 2 does not detect vertical displacement from the 
detection field (i.e. in the z-direction) in this present embodiment.- The detection field 
26 is provided with four, V-shaped channels 38 which permit the interactors 34 to be 
engaged with , the. detection field 26 at a convenient angle. A number (e.g. 12) of 
interactors 34 can be engaged with each of the channels 38. 
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The defection field 26 is coupled to the 1 computer 28 by an interface 40. More 
particularly, a first cable 42 couples the detection field 26 to the interface 40, and a 
second cable 44 couples the interface 40 to the computer 28. The construction and 
operation of both the detection field 26 arid interface 40 willbe described in greater 
5 detail subsequently. r ----* r v 1 " - ' ■ 1 * ' 

■ The video systeiri 30 is coupled to computer 28 by a cable 46. Preferably, the 
computer ■ 28 iincludes an internal video interface card which engages with a suitable 
connector at one end of the cable 46. Other embodiments have other arrangements for 
connecting the video system to the computer Videb Systems 30 and video system 
10 interface cards Cno^shtiwri) afe dommercilally available frbm such 'sources as Radius 
. . Corporation of California. > The video camera Sfreair tie coupleid to the record/playback 
unit 35 -by- a cable 48, or can ^ 'directly coupled into 5 the computer 28 through the 
: \ ^aforementioned video irite^ video camera 

• * 36 aire available from a- number 'of "m^iifactuffcf s iriciudih f g Sofiy Corporation of Japan. 

15 * ) ^Fig^S is-.:a-'side^ieileVationa%iew J '6f , 'dftettic>n field >: 2<SV 'StioWn engaged with 
three of the four V-shaped - channels" 3 only one 

interactor is shown engaged with each of channels 38, a number of interactors 34 (e.g. 
* 12)1 cam be simuli^eoiisly engaged with &cfr the Channels. The body 50 of the 
defeciioii field 26 is preferably made from ah insWkirig material such as wood or 

20/ plastic^ v*-;- r.^i'' • or. - - 1 

■ .'v.; rm's ^ -In"a preferred embodiment of the" present Invention," a plurality of permanent 
'-■-■.'^i'imgnets^Sl areprovided irf a first wall 4 54 c 6f '&ch of the' V-^haped channels 38 
: ^ ;<c6rresp^ lie engaged with the 

-^channels. The- : backs v 56 : of Interactors '-S^'^^iadiapted '"to" erigage""'the" walls 154 of the 
25; -1 channels, i.e- preferably both the walls '54 ^ v bFthe channels and 5 tHe backs 56 of the 
i:A>:r-c* interactors are planar in configuration. Each of the interactors 34 afe aiiso provided with 
a magnet 58 which is attracted to a magnet 52 When "the back 56' of the interactor 34 is 
engaged with a wall 54 of the V-shaped channel 38. This is accomplished by having 
-opposing (N/S) poles of magnets 52' arid 58 face 1 each other when the interactor 34 is 
.30/ engaged with the channel 38. Since the magnets 52 'and '58 are slightly offset in the 
'-vertical > sense when the interactor 34 is engagefr with tlie channel 38, a force F is 
. v • exerted on each of the interactors 34 to firmly hold the back 56 against the wall 54 and 
x to firrnly hold a base 60 of the intera'ctor 34 against ah abutting 'wall 62 of the V-shape 
v -^channels 38; Therefore, the magnets not only hold the ' in teractbrs 34 in position, they 
3 5 also ensure good contact between abutting surfaces of the interactor 34 and channel 38. 
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As seen in Fig. 4, each of the channels 38' afe provided with a number of 
contacts 64 and a grounding strip 66. The contacts 64 are electrically conducting and 
are located in walls 54 of the channels. The grounding strips 66 are also electrically 
conducting and are connected near to the bottom of the walls 62 of the channels. As 
5 will be discussed in greater detail subsequently, an interactor 34 makes electrical contact 
with one of the contacts 64 and with the grounding strip 66 when properly engaged 
with the V-shaped channel 38. The magnets 52 and 58, in addition to urging the 
interactor 34 into the channel 38, also help assure that the interactor 34 is aligned 
properly in the x direction so that it makes good contact with the intended contact 64. 

1 9:.. This. desired result is accomplished because the magnets 52 and 58 will create a force 
that will attempt to align the interactor in the x direcriori': r The contact 64 and the 
grounding strip 66 can be made, for example, from copper or any other suitable 
conductive. material. 1 .; :■<• . .=v -I: i.u ■ , 

, o rln Fig. 5, a- perspective view of ah interactor 34 shows the base 60 and back 
5 , 56: ;The bpdyj68 of the interactor 34 of Fig. 5 is a rectangular prism and is made from 
a non-conductive material such as wood or plastic: Base 60 includes a foil member 70 
which is adapted to engage the grounding strip 66 of me V-shaped channels 38. 
Attached to the back 56 is a contact 72 which is adapted to engage one of the contacts 
64 of the V-shaped channels 38. The foil 70 'and contact 72 are ihade from a suitable 
20 conductive material; such as copper: 

The interactors 34 and the detection field 26 are sized for easy use and for the 
simultaneous use by several, persons. For example, the iriieractors 34 can have 
dimensions of about 0.5 in. X 1.5 in. X 2.0 in., while the detection field can have 
dimensions of about 1 ft X- 2 ft. X 3 in. in height. This permits the interactors 34 to be 

2 5.; .comfortably held in.a user's hand, and allows multiple users to simultaneously interact 

with the detection field-26. : - ; • 

..•>, In Fig. 5a, the internal circuitry of the interactor 34 is shown. The circuitry 
includes an identification (ID. chip 74), and a diode 76 The ID clup is available from 
Dallas Semiconductor of Texas as part number DS2401, arid provides a unique 48-bit 

3 0 identification (ID) when properly queried. The diode 76 prevents false keying, as is 
well known to those skilled in the art of- keyboard design. The ID chip 74 is coupled to 
node 70 by.the diode 76, and is coupled to the contact 72 by a line 78. " 



35. 



In Fig. 6, the internal circuitry 80 of the detection field 26 is illustrated. More 
particularly, the internal circuitry 80 includes the four grounding strips 66 and the 
contacts 64. described previously. The contacts 64 are coupled together in rows by 
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lines 82 and are r cpupled to Vcc (e.g. 5 volts) by pull-up resistors 84. Nodes of the 
circuitry 80 between the pull-up resistors 84 and the contacts 64 form a 12 bit bus 
which are input into. a buffer register 86. Likewise, grounding strips 66 are coupled 
ipto a four-bit bus and are input into the register 86.- A microprocessor 88 (such as an 
M68H141 made by Motorola of Austin, Texas) communicates with the register 86 via a 
bus 90. Colleqtiy t ely, the register 86 and the microprocessor 88 comprise the interface 
40, and the 12 bit bus and the 4 bit bus collectively forms the bus 42. The output bus 
44 is under .the ppntrol of microprocessor 88.; It will be appreciated by those skilled in 
^ *^ t „*-i r interface 4Q will also include otherrwell-known components, such as 
RAM fpr scratch-pad storage, ROM to > store : the control instructions for the 
microprocessor J£8,,e,tc. ^ • Ls *- x -zw $ .rmtr*' ■;.«*■■• v.* . 

In Fig. 7, a computer implemented process 92 that runs oh the microprocessor 
88 to control the circuitry 80 will be described. The instructions for this process 92 are 
stored in .the aforementioned ROM ofthe interface 40, as mil be appreciated by those 
stalled .,in thp.. art. The -process 92 begins i at, 94> arid;Hn & first- step 96, the 
microprocessor 88 plears the.bit maps. By*it;in^ t V4t:is. T iii^i6inaiy- Y digits are mapped 
to particular locations on. the^JboaixL. These:jbit maps ar& f ptbtetably stored in the 
aforementioned RAM jmemory of the interface 40>: Next, m a kep 98, the rows and 
? p }V^ 5 r? f J^^ 100 !^ 80 are read and put 1 into* the current Hit niap. Next, in a step 
20 100, a debounce routine is performed:- Debounee routines aore well known to those 
skilled in the art of keyboard and computer switch design. Next, in a step 102, 
, locations on ,Ae detection field 26 that have "pieces'* are "marked" on the bit map. As 
us,ed herein,, a "piece'' is an interactor;. By "marking" a location^ a piece is engaged 
: , : . r;^ th? ; detector it makes 7efectrical> coht^ Svittf the circuitry 80. 

25, : , ; ^ext, m,a step 104, the ID-of r each of the pieces ?erigaged With the ^dbtection field 26 is 
re ; ad, : and is then compared, to a list < of the* pieces (also ^stdred^n^RAM'TOembry ofthe 
interface 40). In a step 106, if a newly read ID isinot dqual to an old ID for a particular 
position, then a report is made that a new piece has been put down (i.e. engaged with 
; the. detection field;26) : ^nd>an old piece .has been piicked upufrdm the same position. 
30. This information is added to a queue stored in RAM. In a step 108, if the same piece is 
. . t , . ip the same position- on -the detection field, it is reported that the piece is s^ In a 

, r step-. 1 10, if a new piece is detected at a position, it is. reported. that a piece has been 
, placed on, to, the detection field 26; Next, . : the bit map is scanned in a step 112 for 
removed pieces and,, if a removed piece; is detected/the ID is reported. Next, in a step 
3 5 1 14, the current bit map is moved into the older bit map. Subsequently, a step 116 
, . t determines if there is a user, request. If not,;.pracess;cbntrol is returned to step 98. If 
: . there is a user request, that user, request is : handled in >a step 118. .- .In the current" 
preferred . embodiment, this involves, processing , the . user request "to handle the 
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commands "get board state", "get next event", "get. all- events", "erase all events", and 
"get board type (version)." After the user request has been processed, process control 
is again returned to step 98. 

In Fig. 8a, a digital word 120 of the present; invention includes a number of 
5 bits. More particularly, the current word includes 55 bits. Of the bits, a bit BO 
indicates the state, bits B1 T B2 indicate the row, .and bits B3-B6 indicates the column of 
the interactor. Finally, bits B7-54 hold the 48 bit ID of the interactor. This data can be 
passed Xo the computer .28 via bus 44. • ';• 

■:;<_ In Fig. 8b, a .table pf s^te changes is shown- along with their associated 

10 meanings. As described previously, the; word; 120 includes a state which is essentially 
exit/enter (up/down) for a particular, interactor (i.e.e when? and how long has an 
interactor been positioned in the detection field). If the current state value is equal to 0, 
and the last state value is equal to 0, the meaning is that there is no piece (interactor) at 
; . . that <?^i^jpp^tiOT.. ,If the. current, state is 1 and the last state is 0, that means 

1 5 that a piece has been, put down at that row and . column position .: If the current state is 1 
and the last state is ^ 1, that means that.the piece is still down since. that last time that the 
r detection fjeld was scanned. Finally , if the current state is 0 andthe, last state is 1 , that 
. means . mat a P iec e has been picked up, i.e. an interactor. has been removed from the 
detection field. „ . ,,. ; . . r 

20 Figs. 9a, 9b, and 9c illustrate three alternative embodiments for a detection 

. field. In Fig. 9a, a detection field 122 allows an interactor 124 to be linearly placed in a 
multiplicity ,of r positions along an x axis. This is an illustration of ?a one-dimensional 
. detection field. It should be ; npted that, at the trivial extreme, if the detection field 122 
is shortened sufficiently, it can be made just large enough to accept a single interactor 
25 124. This would comprise , a zero-dimensional detection field which would simply 
detect the presence or absence of an interactor and its ID number, i.e. it can operate as a 
simple switch. 

In Fig. 9b, a detection space 126 is illustrated that can accept interactors 128 in 
three dimensions, i.e. along x, y, and z axes. The x, y, and z positions of an interactor 
30 .1 28 can all be used, to determine the context or meaning of the interactor. For example, 
the base platform 130 can have a different meaning from a first platform 132, a second 
platform 134, a third platform 136, a fourth platform 138, and a.fifth platform 140. 
Platform 136 could, for example, be dedicated to changing the identity of one of the 
interactors 1 28. Objects on platform 138 could be "enclosing" interactors on platform 
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140. The meaning' and relationships of the various platforms can therefore be designed 
based upon desired functionalities specified by a user. ! 

It should also be noted that a fourth dimension can be added to the detection 
space 126 of Fig. 9b. In other words, the detection field 126 can change with time. 
5 One way to accomplish this is to allow the platforms to move over time such that their 
meanings change- For example, as indicated by arrows 142, l44, and 146, platforms 
134,136^ and 138 can be allowed to move up arid down; respectively, perhaps under 
the control of a motor (not shown): This permits an interactdr i28 to have different 
meanings over a period of time. For example, the interactor 128 on platform 134 could 
10. represent a^ volume lever for a loudspeaker' whicfii will Hirhinish over time as the 
platform mc5ves downwardly in a ^ direction; ' : THeref6rei it should be clear from the 
foregoing that the detection spaces W 1, 2, 3, 

. .etc. :.l ;v-- j ■ u: >.- ; -v r ' v "- .n<v;^:-'-o ■■f> i ± i\v:**v^ •■ • ■ '• ; 

/ - -In the previous ^ 
15 spaces have always 'been- mapped' by CaftesSaM r (xf y ; "if c&tdmates. In Fig. 9c, a 

- detection space 1 48- in-the ; form : of a ' spherical r globe ; i^^prdvided where a number of 
iriteractdirs have been adhered (such" as By magnets) to its 'surface. With such spherical 
detection spaces or fields, it may be more cohvehieht to determine the position of the 
interactors using a spherical coordinate system. It should also be noted that other forms 

20 of detection fields can be provided including detection fields of irregular shapes. 

'■' M < The present invention will be described more particularly in the form of the 

- : * ~ -fdlldwihg *two- examples.-'- It will be apprebiated^however; itiat there are many other 
r c iapplicatiohs in which the interactor methods arid System <cah be* used with good effect. 

> v ; /* ;.■.'*. , : ^ Example 1: An Audio Control System 

25 In Fig. 10, an interactor 152 is shown which will be useci for a particular 

implementation of the present invention. The interactor 152 includes a body 154 that 
operates fuhctidnally in a fashion very similar to that of the interactor 34 illustrated in 
.." Figs 5 and 5a. The interactor 152 can be used with a J detection field similar to or 
identical with detection field 26 as illustrated in Figs. 1 3, "4, and 6. The detection field 
3 0 : 26 used with the interactor 152 can* also use the same interface 40 to interconnect the 
. * : field with a computer system 28. ^ . .... ~ 

jo « .-v. / x ■* The difference between interactor 152 and the previously described interactor 34 
is therefore design related and not computational in nature in that they support different 
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metaphors. With the interactor 152, a doll's head 156 or other talisman is provided 
with a peg 158 which can engage a hole 160 in the body 154. A small piece of white 
board 162 is removably attached to the body 154 by a pair of hook-and-pile (e.g. 
Velcro®) members 164a and= 164b. The hook-and-pile member 164a is attached to a 
5 surface of body 154 while. member 164b is attached to the back of the white board 162. 
In this way, the white board 162 can be removably attached to the body 154 of the 
interactor 1 52. A name, label, or other indicia can be provided ori the white board 1 62 
with a marker 1 66 as illustrated by the name "Fred." Therefore, the interactor 1 52 can 
be used to represent a person named Fred both by means of the head configuration 156 
10 and the name on the white board 162. It is a useful feature of the present invention in 
- <,. ; -that interactors can be given distinct visual, aural or other sensory identities which aid 
O in the metaphor of the human-computeri interface/ V.-f-.u- • 

■i-i In Fig. 11a; a detection field 166 ( has a number of-interactors 168 that can be 

positioned at various locations. In this instance, one of me interactors 168a represents 

1 5 the user herself. The other interactors 168 in this example represent other people. As 
noted, the pieces, can be moved around such that their relative x, y positions change 
with respect to each: other. . It is therefore possible with the interactors of the present 
. invention to create a "virtual room" wherein the utterances made" by various persons 
represented by the interactors . appear to be spatially located as indicated by the 

20 interactors. Therefore, the interactors and detection fields of the present invention can 
be used as a controller for forming groups in a "virtual room" and for varying the 
relative location of the various members of the group. \ 

, > ? For example, in Fig. 11a, before me user's interactor has been moved, two 
people would appear to be talking to the left of the user and two people would appear to 

25 ;: ....... be talking in front of, and to the right of the user. After the interactor 168a has been 

' moved .-.textile new position 168a', the two people that were apparently to the left of the 
user would now be behind the user, and the two people that were to the front and right 
of the user, would be directly to the right of the user. By removing any one of the 
interactors 168 from the "virtual room," that person would no longer be part of the 

30, conversationi and removing the user's interactor 168a from the room (i;e. removing the 
interactor from the detection field 166) would eliminate the "virtual room." Of course, 
a suitable number of loudspeakers would be required to create the desired illusion. 

In Fig. lib, a slightly altered detection field 166* is used for substantially the 
same purpose, as previously described. However, in the previous embodiment, an 
35 interactor representing the user herself is within the detection field 166, but in the 
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embodiment of Fig. -1 lb, the user does riot have an interactor representing herself on 
the detection field 166\ In the previous embodiment as illustrated in Fig. 1 la, the user 
is said to be "embodied" in that she is on the detection field and can move on the 
detection field relative to other interactors. ^ -However, in the ''non-embodied" or 
5 n omniscient ,, ;yersipn- > sho\yn in Fig. 1 lbv the position of the user is fixed at some point, 
either off or; on the detection field 166 v For example, the user might be positioned at a 
point 1{70 just off of the detection field 166', However, the other people represented by 
interactqrs/168 can be adjusted rdative to the 4 user ; to okain much of the effect 
, obtainable cby<the embodiment illustrated^n'Fijgrl'laJ-'*^ 5 ' ' ,J ' 

10 . , vv Iiy^ig<^ "layouts of a detection field 166 * is illustrated. If an 

interactor is placed near : the back\^ with the person 

represented by that interactor is at its softest. Placing the interactor near the front of the 
-field will. make the' associated per$ori thedoudest. 1 Special positions on the left and right 
t: : .« e^ges^^nd^ow^nthe c^nterj.of^-the defecfioniield^an^pe•Ifdrm^ ^p6<e'i^^uhctions, such as 

-< • .■ - A ; -In; Fig. 12, an interactor system ; 112 /teraGcDMiaiiee-'Wiih* th^present invention 
x includes: an. audio server 174 ^and a numb^ As a system, the 

interacted sy stem 1 7J2 pan perform the functionality described with respects to Figs. 1 la 

. - , :; and41b.; ■% : / » : > > rr --^^rd -d* « • ■ / * v^v : " 

20 The audio server -1£74 includes a data server ^178;^a MIDI ' timepiece 180, a 

number of MIDI devices 182, and an audio concentrator 184. The data server 178 
, . ^receives data from a network bus 186, ah^ timepiece 180 by a 

; '. v3V bus^l 8g.,-The^MIpI timepiece ■ 1 80. is connected to a rack ^bf^MIBrdeviefes 182 by a bus 
; 190, and .the output of the MIDI devices; il 82 are: doupled to the- cohcehtrator 1 84 by a 

2 5 £ ; bus 192. The concentrator 1 84 has, as inputs, a^ tiumber of audio lines >1 94. 

» v , *, Each workstation 17.6 includes a computer :1 96, interfaces' 198, and detection 
fields 200 as described previously. The detection fields ; 200: can have one or more 
interactors;202 placed upon their surfaces 5 as previously illustrated arid described with 
reference -to Fjgs, 1 la and J lb. The* workstation* further; includes a pair of stereo 
30 , -.loudspeakers 204; and a pair of stereo microphones 206: .The 'loudspeakers 204 are 
coupled directly into a control box 208 which include loudspeaker amplifiers. The 
. , . -microphones are, coupled to a pre-amplifier 210 which, in turn, are coupled to the 
r : . s - control box 208., The control box 2Q8 also includes microphone amplifiers. The audio 
; , ( .^lin^s 194 carry the microphone signals : to ;thei concentrator 184,: and the loudspeaker 

3 5 signals from the concentrator 184 to the various speakers 204. 
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The software operating the interactor system 172 is conceptually illustrated in 

block diagram form in Fig. 13. The databus 186 carries the data necessary to 
interconnect the various components of the system 172 and can, for example, be 
implemented on an Apple LocalTalk or Ethernet network protocol. It should be 
5 understood, however, that other network protocols such as Novell Netware or custom 
network software can also be used to provide the networking functions of the network 
bus 186. 

Three software routines are used to implement, the interactor system 172 of the 
present invention. Namely, each of the workstations 176 operate an application 

1 0 program and a network library, and a data server 178 operates data server software and 
the network library. The application program 212 runs on the computer 196 of each of 
the workstations 176 that are part of the interactor system 172. Network libraries 214 
likewise each run on a computer system 196. The network library communicates with 
th 5 ndt ^° rk bus . via a conc eptual link 216 and with the application program via a 

1 5 ~ conceptual link 218. Tlie application program 212 cornmunicates with the network bus 
1816 via a cpnceptuaj^njc , 22^ : ' The links 216, 218, and 220 .are considered conceptual 
in that they are not physical links to the bus but, rather, logical^ links through operating 
system software, network software, internal buses, network cards, etc. 



20 



The software runriirig on the data server 178 includes the network library 222 
and the data server software 224. The network library has a conceptual link 226 to the 
network bus and a conceptual link 228 to the data server software 224~..The data server 
software has a conceptual link 230 to the network bus 1 86, 

In the present implementation, the conceptual . links 220 and 230 from the 
^ network bus 186 to the application programs 212 and to data, server software 224, 
25 respectively are AppleEyents created by an Apple networking system. . The conceptual 
links 216 and 226 between the network library and the network bus 186 are preferably 
standard AppleTalk or Ethernet data packages. 

Fig. 14 illustrates the application program 212 running on the workstations 
176. the process 212 begins at 232 and, in a step 234, the process is initialized with 

30 the board type, and the current board space. Next, in a step 236, the state of all 
persons on the system is communicated based upon the board state and board type. 
After the initialization and communication steps, the process enters an event queue 238 
to await the next event. If the next event is a "pick-up" event, a step 240 determines 
whether the interactor is in a control space. As used herein, a control space is a 

3 5 dedicated portion of a detection field used to control the process. If it is an assignment 
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control space (where meanings are assigned to interactors) control is returned to the 

■ ■ . ■ ' *" * ' ' ' ' • * 

step 238. If the control space is a people control space, the audio is cut off in a step 

242 and process control is again returned to step 238. 

If step 240 determines that the interactor is not in a control space, it is 
5 determined in step 246 if the board (i.e. the detection field) is self-embodied. If yes, it 
is determined in a step 248 if the interactor representing the user ("self") has been 
removed from the board. If not, the system provides an audio feedback and a new state 
to the server in a step 250. If the interactor representing the user has been removed 
from k self-eriibodied board, a step 252 provides audio feedback and turns off the 
1 0 sound to all users. 

If the event queue detects an interactor being put down on the detection field, a 
: step 254 cletermiries whether it was ^ If yes, people 

information is provided in a step 256. If it was put into an assignment space, a step 
258 inputs the assignment to the interactor. "After either step 256 or 258 are completed, 
15 process; control is returned to step 238. Next, in a step 260, it is determined whether 
there is a self-embodied board. If yes, a sjep 268 determines whether an interactor 
representing the user has been placed on the detection field. If not, or if step 260 
determines that is not a self-embodied board, a step 264 provides audio feedback and 
resets the data concerning the person represented by the interactor. Otherwise, step 268 
20 determines an interactor representing the user has been placed on the detection field, 
J audio feedback is provided, and a reset of all of the people represented by the 
' interactors on the board is initiated. After steps 264 or 266 is completed, process 
control is returned to step 238. " 

, i-w i n pig. 15, the functionality of the net work librairy 214 of Fig. 13 is shown in 
'25 greater detail. The functionality of network library 222 is substantially the same. The 
process 214 begins at 268 and, in a step 270, it is determined whether a function call 
' ' has been received. If not, the process 214 goes into an idle loop^ awaiting a function 
call. If a function call "receive event" has been received, a step 272 provides a 
requesting program with the information regarding the event. If a functional call 
30 corresponding to "send eVerit" is received, an AppleEvent is created from the function 
ball to communicate with other programs in a step 274. Process control is returned to 
the funbtion call event loop 270 after the completion of either steps 272 or 274. 

" ' In Fig. 16, the operation of data software server 224 of Fig. 13 is illustrated in 
1 : greater detail. A process 224 begins at 276 and, in a step 278, it is determined whether 
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an AppleEvent has been received. , Again, this process 224 is Macintosh® specific, and 
like or equivalent processes can be used in other types of computer systems. If an 
AppleEvent has not been received, the AppleEvent loop 278 repeats until that 
AppleEvent is received. If the AppleEvent is a "value change" AppleEvent, a step 280 
5 ( determines whether there is a privacy violation. If yes, a step 282 notifies an error 
handler to handle the privacy violation. Process control is then returned to step 278. If 
( there is not privacy violation detected by step 280, there is an update of dynamic 
, information database in a step 284. Next, in a step 286 v MIDI data is calculated and 
> ^ sent. In a subsequent step 288, users with a vested interest in the function are notified, 
10 and process, control is returned to step 278. If a "value inquiry" AppleEvent is 
^.detected, a step 290 :detei^es, whether ;there is. a. privacy Violation. If yes, a step 292 
, notifies the network r library ; with - the error function and process control is returned to 
step 278. If there is not a privacy, violation as determinedly step 290, information is 
retrieved from the database in a. step 294. Finally, in a step 296, the network library is 
15 called to reply and process, control is returned to step 278, : ; v ; . 

; v<,V? ^ v ;t - Example 2: Video tape Marking System? - 

In this second exainple, an interactor system such; as interactor system 24 is 
controlled to "miark" or yog 1 ' events in a videotape. InFig. 17, a detection field 298 
includes three zones 300a, 300b, 300c and a number of interactors. 302. Each of the 

20 interactors has a semantic meaning due to its identity, due to their position in the 
various zones 300a, 300b, and 300c of the detection field 298, and due to their amount 
or "type" of time they have been present in the detection ; field (up/down or, as 
sonietimes referred to herein, exit/enter). The various objects 302 can be used mark 
and control the temporal flow of a recorded medium as described previously with 

25. .regards to Fig. 2. • - ^ f ; ; : > 

. As used herein, "temporal flow" will refer to the flow of events, either in real 
time or in some other time related context. Therefore, either events can be marked in a 
temporal flow, or events that have been previously recorded or that are being 
concurrently recorded can be marked in the temporal flow. The "marking" may only be 

30 literally temporal (such as in real time), temporal with ; regard to a specific origin (such 
as seconds since the start of the tape), or temporal, only in the sense that the measure 
could, be translated into a temporal stream (such as feet of tape or frame number). 
While the present example relates to a recorded video medium, the marking and control 
, of the temporal flow, of another medium, such as an audio medium,, may also be carried 

35 out. >. . ; 



RN.Qnnrin- *-wn q?a«^7Q4o i ^ 



WO 97/06479 



- 19- 



PCT/US96/12657 



In Fig. 1*8?. a computer implemented pYocess 304 operating on a computer 28 of 
Fig. 2 for marking and controlling a temporal flow begins at 306 and; in a step 308, it 
is determined whether a non-board event ha$ been received. If so; this M other ,, type of 
event is processed in a step 310 and process control is returned to step 308. Next, in a 
5 step 312, it is determined* whether a board event has* been received. If not, process 
control is returned to>step 308. If a board event has been received, the board is polled 
in a step 31,4: aind it is determined in a step 3 1 6 whether a null board event has been 
received. A null: board event may be that no interactoirs have bee^ perceived in the 
, detection fieldvor that no changes have been detected 7 in the state of the interactors in the 
1 0 , detection field; If so, process control returns to 308f v However, if a board event has 
i been received (i.e. it is not a null board evertQ^th^bbard; event is* parsed in a step 318. 
* Next, in astep 320, it is ddermined^the ■evenftj^ baseidlipbh any combination (e.g., 
any one, -anyitwo; -or;, all -three) 1 ;**? the /interactof % ID, location^ an* whether it is up or 
v/.down (MV the^timep in a step 332, 

15 the parsed evem is processed^ controls the 

media based upon the event. If it is a binding event, a step 326 processes the binding 
event. If tois^a;marking events a step 3£4^marks theiemporal flow. In this instance, 
the temporal flow is marked by receiving frame information from the video player and 
storing; that frame information on the computer 

20<r - Iflthe.'Hvent type 4s -unrecognized, or -after stems' 324, 326, : or 328 have been 

processedv process control returns to stepSOS^ r ■ " - 

; \: ,vStep£324&f Fig.18 is illustrated iri ^ a media 

c : -fibased^iipoh the evertt; process^324 begins kt 320 and; ih a step 332, the meaning of the 
> -r. r linteractorinlthe detection 1 field i& determined^ whether it is 

2,5 n u P on down. The meaning -may be detei^n^based J upori'any cdmbination of the 
presence of the interactor (up/down), the ID of the iritefector, ahd-the location of the 
interactor. Next, in a step 334, this meaning is converted into control commands (e.g. 
. . .f*. stop,ifast-fbrward, speed etc.) for the media system; The prbcess 324 is completed at 

30 ; ;v; Step 326 of FigM8 is illustrated in greater detail in Fig; 20. Process 326 
begins at 338 and, in a step 340, the current meaning of the interactor is displayed. The 
, system then determines whether the user wants to redefine the ciih-ent meaning of the 
: interactor in a step 342. If not> the process 326 is completed as indicated at 352. If the 
r .user does wish to redefine the meaning of a particular interactor, it is determined in a 
•35 . - step 344 what, type of redefinition is desired: If the meaning of the Ibcation is "re-bind 
the ID", then a step 346 redefines the binding of the ID to the meaning. If the meaning 
of the object is "re-define the location", the system redefines the binding of the location 
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to the meaning in a step 348. If the meaning of the location or the ID is "re-define the 
proximity", a step 350 is redefines the binding of the proximity to the meaning. As 
used herein, a definition for "proximity" is a measure of distance between the interactor 
and the detection field, or the position of an interactor in a detection space. After the 
5 completion of the binding steps of 346, 348, or 350, the process 326 itself is completed 
as indicated at 352. 

The step 238 of Fig. 1 8 is illustrated in greater detail in Fig. 2 1 . The process 
:•' ' 328 begins at 352. and, in a step 354, the current temporal value of the media is 
•• • . retrieved. Next, in a step, 356, a mark is stored with a temporal value and meaning 
,10. based upon the ID, location, and how the interactor has been placed "up or down" in 
the detection field. The p^ocess 328 is then completed at 358. : 

The step 310 of Fig. 18 is illustrated in greater detail in Fig. 22. The 
process 310 begins at 360 rand/ in a' step 362, an event type is detennined. If the 
event type is board contiroi; !a step 364 issues board control commands. If the event 
1 5 type is "database," a step 366 manipulates the database of marks. If the event type 
is "riavigate media," a media If the event 

type' is- • ? devicc"'tohMV , ''-a" < device"-te control is selected in a step 370. After the 
completion of steps 364, 5 366' 368, or 370, the process 31 6' 'is completed as 
indicated at 372. 

20 While this invention has been described in terms of several preferred 

embodiments, there are alterations, permutations, and equivalents which fall within the 
scope of this invention. It should also be noted that there are may alternative ways of 
implementing both the process and apparatus of the present invention. It is therefore 
intended tharthe following appended claims be interpreted as including all such 
- 25 alte'i^diis,-i»rmutaiio'n^;' : and equivalents as fall within the true spirit and scope of the 
present invention. " '' ' - ' r - 
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j :* Claims * 

1. - A computerized interactor system comprising: 
- a detection space; , i ' ' • - ■ . ■ ; j - 

at a plurality of physical interactors which can be manually placed within said 
5 detection spac^ and removed from said detection space,- wherbin said detection space 
\ comprises a., plurality- of positions at which respective ones -of said plurality of 
interactors, may be selectively manually placed arid removed thereby to provide a 
plurality qt .selectable and changeable arrangements' of said pjlurality of interactors at 
said plurality ^ofposjtionsof said detection ^space; * > - ' oxrss.r. * 

10 \ ? ^ V?!f r * ace ^ s R onsi y e .S9-v.?n ; iqtempjor in said detection space and operative to 
P^idje an interactor^signal indicative of the identity, and ^tatus; ...pf said interactor; 

, >, . ; . :. a iwr ' V: i;^-u:«c- dtit '•• -n 

,£ .?°™P ut ? r sys^^ process said 

infractor signal to create a : control input that is ^ in^cative pf^aid identity and status of 
said interactor within a predete^ned semantic fram and , , .< 

15 an application system coupled to said computer system and responsive to said 

control input. ; ^ _ - 

;f , 2. A computerised interactor system as recited in claim . 1 wherein said 
, ^pluralit^ of interactors may be manyaUy > placed in and. rempyed from said detection 
2 0 space by a plurality of users of the system. _ r . . . ; , ^ : , 



3 . A computerized interactor system as recited in any of claims 1-2 wherein 
each of said interactors comprise identification circuitry and wherein said detection 
space comprises internal circuitry adapted for connection with said identification 
circuitry of said interactor, said internal circuitry of said detection space being coupled 
to said interface. 
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4 . A computerized interactor system as recited in any of claims 1 -3 wherein 
said at least one physical, interactor comprises a distinct visual feature for 
metaphorically representing said identity of said interactor. 



5. -A computerized mteractor system as recited in any of claims 1-4 wherein 
said application system comprises at least one of an audio application system means and 
a video application system means'.- ■ • '• ' 



; / . : 6. A method for controlling a computerized system comprising the steps 

10 of: U: v 



a) providing a detection space; 

b) ; placing-a physical -and identifiable member having a semantic meaning 
': " ' • ,.« independent of said member within said detection s^ace; 

c) determining said semantic meaning of said member within a given 
semantic context by determining a selected position of said member in 
said detection space and an identification of said member; and 

; - .v~ d) x controlling a computerized system in response to said-semantic meaning 
of said, identifiable number: ' ' v 



20 1 • A method for controlling a computerized system as recited in claim 6 

wherein, said step of determining said semantic meaning of said member comprises 
determining a temporal relationship of said member placed in said detection space. 



8. A method for controlling a computerized system as recited in any of 
claims 6-7 comprising placing a plurality of physical and identifiable members within 
said detection space and determining the semantic meanings of said plurality of 
members. 
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9 . ^ ^system for controlling a computerized system comprising: 
at least one physical control member having an identifiable identity; 
a field receptive to said control member; 

an interface coupled to said . field and operative to develop an identity signal 
5 representative .of said identity ; of said control member, said interface being further 
operative to detect a status of said member received by , said field and to develop a status 
signal representative of said status of said member; and 

a processor coupled to said interface and receptive to said identity signal, said 
processqr^p^^ control signal for a system to be 

10 controlled. ^ 

.. v r 10. . A system for contrp system as recited in claim 9 

wherein said status of said member is a functions of; apposition of said member received 
by said field and of a time said member is received by said field. 



11. A system for controlling a computerized system as recited in any of 
claims 9-1.0 wherein said system to be controlled is at: least on eof an audio application 
system means and a video applicatipn system' means.; > 



20 . . : . A2, ,A ; system for controlling a computerized system as recited in any of 
v . claims 9-11 wherein said control member comprises at least one distinct visual feature 
for metaphorically representing said identity of said control member: / 



. 13. r A method for marking events within a temporal flow comprising the 
25 steps of: , ^ . .. 
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a) monitoring a temporal flow; , v /. 

b) providing a detection, space; 

c) placing an identifiable member having a semantic meaning within said 
detection space; 

d) . detennining said semantic meaning of said member that is different from 

spd member in a context of said temporal flow; and 

e) recording an event related to said temporal flow and to the semantic 
meaning of said identifiable number. 



1 ,;Q , > iic ^r r n^thqd .for marking events within a temporal flow as recited in claim 
13 providing ^ deitection space accessibly by a plurality of users.; , 



15. A method for marking events within a temporal flow as recited in any of 
claims 13-14 comprising: , , 

1 5 placing a plurality of identifiable members within said detection space; 



f . (1 determining the semantic meanings of said plurality of members; and 

recording a plurality of events related to said temporal flow and to the semantic 
meanings of said plurality of members. 



2 P; - • ; , 1 6 . . A method for marking events within a temporal flow as recited in any of 
claims 13-15 wherein said step of determining said semantic meaning of said member 
comprises determining a selected position of said member placed in said detection 
space. 
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17. A method for marking events within a temporal flow as recited in any of 
claims wherein 13-16 wherein said step of determining said semantic meaning of said 
member comprises determining ah identification of said member. 



18. A method for marking events within a temporal flow as recited in any of 
claims 13^17 wherein said step of determining said semantic meaning of said member 
comprises d&eriMriihg a temporal relationship- of saiid rtiember placed in said detection 
space. 




10 19. A system for marking events occurring in a recorded media comprising: 

j t a 1 display system for ^displaying a recording; said system providing an event 
timing information 'Cohcemihg : eveW 

a plurality of event markers, each of which is provided with an event marker 
identifier; 

15 an event field receptive to said event markers iarid operative to provide said event 

marker identifier in an event marker time; and 

a processor coupled to said display system to receive said event timing 
- : information arid said event marker identifier; and ^^eiHative to mark an event based upon 
said event timing information, said event marker time, and said event marker identifier. 



20 




20. A system for marking events occurring in a recorded media as recited in 
claim 19 wherein said plurality of event markers are operable by a plurality of users for 
making said plurality of event markers removably received by said event field. 
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